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Working memory (WM) requires selective information gating, active information 
maintenance, and rapid active updating. Hence performing a WM task needs rapid 
and controlled transitions between neural persistent activity and the resting state. We 
propose that changes in correlations in neural activity provides a mechanism for the 
required WM operations. As a proof of principle, we implement sustained activity and 
WM in recurrently coupled spiking networks with neurons receiving excitatory random 
background activity where background correlations are induced by a common noise 
source. We first characterize how the level of background correlations controls the stability 
of the persistent state. With sufficiently high correlations, the sustained state becomes 
practically unstable, so it cannot be initiated by a transient stimulus. We exploit this in 
WM models implementing the delay match to sample task by modulating flexibly in time 
the correlation level at different phases of the task. The modulation sets the network 
in different working regimes: more prompt to gate in a signal or clear the memory. We 
examine how the correlations affect the ability of the network to perform the task when 
distractors are present. We show that in a winner-take-all version of the model, where two 
populations cross-inhibit, correlations make the distractor blocking robust. In a version of 
the mode where no cross inhibition is present, we show that appropriate modulation of 
correlation levels is sufficient to also block the distractor access while leaving the relevant 
memory trace in tact. The findings presented in this manuscript can form the basis for 
a new paradigm about how correlations are flexibly controlled by the cortical circuits to 
execute WM operations. 
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INTRODUCTION 

Working memory (WM), defined as short term storage of infor- 
mation that is actively used on-line to carry out actions and 
decisions and drive learning, is one of the key processes that 
underpins our cognitive abilities. WM is characterized by an 
information bottleneck with resources restricting its "on-line" 
capacity to a relatively limited number of items at high levels of 
performance (Miller, 1956; Luck and Vogel, 1997; Cowan, 2001; 
Vogel et al., 2001) and a rapid decrease in performance with item 
number due to limited resource allocation (Wilken and Ma, 2004; 
Bays and Husain, 2008; van den Berg et al., 2012) as suggested 
by the recent experiments. Furthermore by its very nature, WM 
is characterized by the need to operate on the stored informa- 
tion rapidly. Such limitations and rapid operations of WM create 
the need for selective gating and rapid updating as well as active 
information maintenance to enable its immediate use (Frank 
et al., 2001). One of the central unresolved issues is how the 
multiple requirements for WM are carried out by the brain cir- 
cuits: whether the maintenance, read-in, gating, and read-out are 
implemented by separated systems (e.g., as suggested by Baddeley, 
2003) or by operations within the same neural circuit (e.g., as 
recently put forward by Machens et al., 2005). 



Electrophysiological data from primate performing delayed- 
response tasks show that persistent neuronal activity in prefrontal 
cortex (PFC) underlies the maintenance of WM: during the delay 
period between the stimulus presentation and the read-out, neu- 
rons selective to the memorized stimulus fire spikes at an elevated 
rate with respect to the resting state (Fuster and Alexander, 1971; 
Fuster and Jervey, 1981; Funahashi et al, 1989; Miller et al, 1996; 
Romo etal., 1999). 

In order to highlight the unique requirements of the WM as a 
neural process let us focus on the DMS task with distractors as a 
prototypical example (Miller et al., 1996). In this task the subject 
must remember the identity of an item briefly shown (the sample) 
and respond correctly only when the item is shown again (match) 
all the while ignoring other items flashed (distractors). To execute 
correctly this task, the neural circuitry needs to perform three 
operations (Figure 1A): first, encode and maintain in memory 
the sensory stimulus during the delay period; second, robustly 
maintain the memory face to distractors presentation; third, erase 
the memory trace at task completion to make the store available 
again, given the limited WM capacity. These operations are trans- 
lated in terms of neural activity as follows: item-related activity 
is turned on rapidly and selectively by the sample-stimulus, is 
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FIGURE 1 | Outline of the models. (A) Time sequence of the delay 
match-to-sample task for the working memory network. Active neurons 
are represented in full colors. Successively: (I) both populations are in 
a quiescent state, (II) sample stimulus (blue arrow) activates blue 
population, (III) the network prevent a distracting stimulus (red arrow) 
to activate the red population, (IV) match stimulus allows the read-out 
of the encoded memory in the blue population, and (V) persistent 
activity is erased in the blue population. (B) Correlations in external 



background activity generated by a common source of noise, in 
addition to independent sources of noise. (C) Single unit network 
receiving shared and independent sources of noise. (D) Winner-take-all 
network with two competing excitatory populations coupled through 
one inhibitory population. In addition to independent sources the 
excitatory populations receive background activity by two different 
common noise sources. (E) Two-unit network with two excitatory 
populations receiving shared noise. 



protected from distractors during the delay period, and is rapidly 
turned off on response by the match. 

A number of spiking network models have been conceived to 
describe the neural substrate for WM where persistent activity is 
maintained by recurrent connections that allow for co-existing 
attractor memory states and a ground non-memory state (Amit 
and Brunei, 1997; Compte et al., 2000; Brunei and Wang, 2001; 
Gutkin et al., 2001; Laing and Chow, 2001; Machens et al., 
2005; Miller and Wang, 2006; Ardid et al, 2010). In some of 
these models, protection from distractors and memory clearance 
are performed through the recruitment of inhibition (Compte 
et al, 2000; Brunei and Wang, 2001; Machens et al., 2005). 
As an alternative to the erasing-by-inhibition paradigm, it has 
been shown, in a spatial WM model, that a transient excitatory 
stimulus matching the memory trace "location" on the network 
extinguishes the persistent state by transiently synchronizing the 
spike-times of the neurons (Gutkin et al, 2001; Laing and Chow, 
2001). This work, along with Machens et al. (2005) showed how 
the read-out and clear-out can be merged into a single operation. 
However, in these alternative frameworks, protection from dis- 
tractors, or selective gating, was not addressed. Here we propose 
that the gating is obtained by flexibly controlling the spike-time 
structure of the WM network activity. In support of this idea, it 
has been shown that spike-time synchronization is modulated in 
association with cognitive processing (Abeles et al, 1993; Riehle 
et al., 1997; Funahashi and Inoue, 2000) and in particular in WM 
(Sakurai and Takahashi, 2006; Pipa and Munk, 2011). 

Critically, WM trace appears in the context of on-going back- 
ground activity. While background activity is not related to 
task parameters, this is not without structure. Correlations have 
been found broadly in spontaneous neural activity in the cortex 
(Tsodyks et al., 1999). In particular, it has been shown that nearby 



neurons receive common inputs from afferent neurons making 
their voltages correlated (Lampl et al., 1999). Effects of correla- 
tions have been widely studied for their effect on population code 
(Salinas and Sejnowski, 2001), to measure network connectivity 
(Aertsen et al, 1989; Cocco et al., 2009), on neural dynamics 
for coupled neurons (Ly and Ermentrout, 2009), and for multi- 
ple independent neurons (Galan et al., 2006; Moreno-Bote et al., 
2008). 

In computational models of WM the background activity has 
been largely seen as problematic for memory maintenance. For 
example one of the more sensitive technical issues addressed 
by several computational proposals is how to stabilize the WM 
trace in face of random background activity (Compte et al, 
2000). The benefits of external input correlations on persis- 
tent activity in recurrent networks have only recently started 
to be addressed theoretically (Buice et al., 2010; Polk et al., 
2012). For the specific case of line-attractor networks (model- 
ing parametric WM) Polk et al. (2012) showed in a detailed 
analysis how properly tuned input noise correlations can pro- 
mote stability of the persistent firing rate. This was further 
noted in Lim and Goldman (2012) who also showed that the 
correlation structure of background noise can suggest the opti- 
mal architecture of neural networks for short term memory 
performance. 

Finally, in this article we examined the influence of input 
correlations on recurrent spiking networks, finding that the cor- 
relation level in fact may destabilize the persistent activity state, 
rendering it a slow transient state. Buice et al. (2010) used a 
path integral approach to integrate the effects of correlations 
and synchronization into a rate model of recurrent networks 
and examined the stability of the persistent state. For a bistable 
firing-rate network they noted that transient increases in input 
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correlations (synchronizing noise input) can lead to a turn- 
off of the persistent activity. This approach may in fact pro- 
vide an analytical framework of the observations we make in 
the present manuscript for recurrent spiking networks and the 
correlation-based control of the persistent state lifetime. In this 
manuscript we also go beyond noting that input correlations 
defined the lifetime of persistent activity; we show that input 
correlations can effectively control the access to WM by disal- 
lowing transient stimuli to initiate persistent activity. The func- 
tional consequences of these two effects are the central topic of 
this work. 

To demonstrate that, by controlling the correlation-driven 
synchronization of the background activity it is possible to con- 
trol the lifetime of the persistent state and to manipulate selec- 
tively the transitions in sustained activity and consequently to 
perform the required operations of the WM task, we first con- 
sider a minimal recurrent network. In this recurrent network 
the neurons receive an excitatory random background noise, and 
background correlations are induced by a common noise source. 
Then we implement a discrete item WM model where the modu- 
lation of the background correlation level sets the network into 
different regimes allowing for loading of memory, protection 
from distractors and memory persistence. In addition we show 
the possibility to merge the read-out and the clearance in a sin- 
gle operation since the presentation of the match stimulus can 
directly quench the persistent activity. 

MATERIALS AND METHODS 
NEURAL MODELS 

In this work we study recurrent spiking networks that show bista- 
bility between a ground state and an active persistent spiking 
state. Our goal is to construct and analyze a minimal network 
capable of showing the required bistability. Hence we consider 
networks of recurrently connected excitatory pyramidal neu- 
rons. The elements of the network are represented by non-linear 
"point" neurons that are sparsely connected by instantaneous 
excitatory recurrent synapses. The dynamics of a neuron's mem- 
brane potential v is described by the Quadratic Integrate and Fire 
(QIF) equation, which represents the normal form of type 1 spike 
generating dynamics (Ermentrout, 1996): 

dv i ■, 
X dt = +Isyn(t) (1) 

v(t) = V t -> V r (2) 

where x represents the membrane time constant, — b is the rest- 
ing potential, I(t) the input current, V t a spike threshold, and 
V r the reset membrane potential. The voltage of the neuron is 
scaled such that v is a non-dimensional variable. When the mem- 
brane potential neuron attains the threshold value v = V t , a spike 
is emitted and a post-synaptic current (PSC) is transmitted to 
an output neuron. We set the parameters as follows: V r = —20, 
V t = 20, b = 1 and t = 20 ms. 

The input current to a given cell in the network is decomposed 
into three different components: 

WO = W) + hit) + lUt) 0) 



where I r (t) represents the recurrent input due to other neurons 
in the network, I 5 (t) represents the input from external stimuli 
directed to the network, and -fba(f) represents a non-specific 
background activity. Each of the three currents corresponds to 
a sum of PSCs originating from synaptic inputs generated by 
the presynaptic neurons at times t„. The PSCs are modeled 
with delta pulses: 

a {tnl 

where ] a represents the synaptic strength for a given connection 
and could be positive (corresponding to an AMPA synapse) or 
negative (corresponding to a GABA synapse). 

BACKGROUND ACTIVITY AND CORRELATIONS MEASURES 

Ample data shows that cortical neurons receive a large amount 
of non-specific cortical and subcortical inputs whose structure 
is not directly related to the specific task and stimulus [e.g., see 
Shadlen and Newsome (1994) and summary of data in Amit 
and Brunei (1997)]. We refer to this type of input as an exter- 
nal background activity. It is taken to be composed of sequences 
of excitatory PSCs of synaptic strength Jo and with the synap- 
tic times generated by a Poisson process. The synaptic currents 
are depolarizing in accordance with the notion that cortical 
neurons receive inputs from long-range excitatory glutamatergic 
projections. 

In our model, this background activity can be either unstruc- 
tured (uncorrelated) or structured (correlated). The correlation 
level, between two spike trains S,(t) and Sj(t) is given by: 

kit = — *— / CCVF„(s)ds (5) 
" (Sj(t)) J ' 

where CCVF corresponds to the cross-covariance function 
(Brette, 2009). This function is normalized to zero if S,(f) and 
Sj(t) are generated by independent Poisson processes. 

We consider two ways for constructing the background 
activity: 

Uncorrelated background activity 

All N neurons receive spike trains generated by N independent 
channels with rate vrj. This leads to CCVF (5) = 0 and thus the 
correlation level is k$ = 0. 

Correlations induced by a common source of noise (Figure IB) 

All the N neurons receive inputs both from independent chan- 
nels, with frequency (1 — A)vrj, and from a common channel, 
with frequency kxiQ and 0 < X < 1. Each channel generates a 
spike train with Poisson statistics. The average background input 
rate is vn for each neuron. The cross-covariance function is then 
CCVF(s) = k(S l {t))h(s) and the correlation level is kit = k. This 
gives purely spatial correlations. 

We measure the correlation level of the synaptic input among 
cells in the network with the mean Pearson correlation coeffi- 
cient. We first compute a running mean (averaged over a time 
window of 5 ms) of the synaptic input I' a (t) for each cell during a 
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certain interval of time. Then we compute the Pearson correlation 
between the synaptic input of two cells: 

cov(44) 

Pij = r ( 6 ) 

Finally we compute the average over all the cell pairs of the net- 
work p = [2/N(N - 1)] Yl N, = i J2f = i+ , Pij. In particular, in 
Figure 4, we performed this measure for the recurrent input a = r 
and background input a = ba . 

FUNCTIONAL NETWORK STRUCTURES IMPLEMENTING WM TASKS 

In this work we study three different networks. We start out 
by studying a homogeneous network of recurrently coupled 
excitatory neurons. This network can be also thought of as a 
encoding a single item of WM: a "single-unit network". The sec- 
ond model consists of two homogeneous excitatory networks 
coupled together through a population of inhibitory neurons: a 
"winner-take-all network" of two discrete competing short-term 
memory items. The third model is made up of two recurrent 
excitatory populations without mutual connections: a "two-unit 
network". 

Single-unit network 

A homogeneous network with N = 100 identical sparsely cou- 
pled neurons is represented in Figure 1C. Each neuron in the 
network receives synaptic inputs from cN other excitatory neu- 
rons, where c = 0.2 is the probability of connection, and / = 
0.26 is the recurrent synaptic strength [described in Equation 
(4)]. Neurons receive excitatory inputs also from external back- 
ground activity, with synaptic strength Jo = 0.151 and firing 
rate vo = 106 Hz. Neurons also receive an excitatory input 
from external sensory stimuli with synaptic strength J\ = 1.5 
and firing rate vi = 56 Hz for a duration of 50 ms, as will 
be described hereafter. Parameters of the network are chosen 
such that the network sustains a quiescent state, with low fir- 
ing rate (/ < 5 Hz), and a persistent state, with high firing 
rate («20 Hz). 

Winner-take-all network 

The second model is a reduced version of the network pro- 
posed by Amit and Brunei (1997) (Figure ID). The network 
is composed of two excitatory populations and one inhibitory 
neural population. Each of the two excitatory populations has 
Ne = 40 neurons, and the third population is made up of Ni = 
20 inhibitory neurons. An excitatory neuron receives synaptic 
inputs from cee-Nb (cee = 0.45) neurons of the same popula- 
tion, with synaptic strength /ee = 0.3, and from cei-Nj (cei = 
0.35) inhibitory neurons with synaptic strength /ei = —0.25. An 
inhibitory neuron receives synaptic inputs from cj^Ne (cie = 
0.34) excitatory neurons with synaptic strength /ee = 0.05 from 
each excitatory population. Other parameters of the network 
are: Jo = 0.4, J\ = 1.5, vo = 60 Hz, and vi = 17 Hz. In addi- 
tion we augment the mutual inhibition network with the added 
feature to control the amount of correlated noise in each 
excitatory population. More precisely each excitatory popula- 
tion receives background activity by common noise sources 



in addition to independent sources. In such a way the cor- 
relation level k is regulated independently in each excitatory 
population. 

Two-unit network 

We devised a third version of our network models that is made of 
two excitatory independent populations, each one making recur- 
rent connections with itself. Both networks share a common 
excitatory noise source projecting simultaneously to all excitatory 
neurons in addition to the independent uncorrelated background 
noise (Figure IE). Since the common noise source is shared 
between the two populations the correlation level A. varies equally 
in the two excitatory populations. The parameters of each exci- 
tatory population are those given for the single-unit network, 
with the only difference that we used here a larger network (N = 
1000) and we scaled accordingly the recurrent synaptic strength 
(/ = 0.026). 

DELAYED MATCH-TO-SAMPLE TASK 

We study the spike-timing based mechanisms able to implement 
the DMS task (Figure 1A). The sequence of operations and the 
neural dynamics aim to reproduce the experimental results of 
Miller et al. (1996). For illustrative purposes, the discrete items 
can be viewed as corresponding to colors. The activation of one 
excitatory population encodes color blue, that we define pop- 
ulation B, while the other encodes color red, that we define 
population _R. If the populations are both in a quiescent state, the 
state of the network represents the absence of color information. 
For simplicity we represent the spontaneous state as the quiescent 
state (average firing rate ~0 Hz). 

During the task, the animal has to maintain a memory of an 
item (a color) during the delay period. In terms of neural activity, 
the corresponding excitatory population should be activated and 
maintained in a persistent sate. Additionally the model should 
protect the memory from the presentation of a distractor stim- 
ulus. At task completion after the decision, the system should 
erase rapidly the memory, i.e., the persistent activity should be 
deactivated to its quiescent state. 

To establish that a network performs a WM task correctly we 
require it to perform all the operations of the task. The first oper- 
ation, load, corresponds to loading the memory by the sample 
signal, and corresponds to B that is activated in a persistent state 
while .R is in a quiescent state. The second operation, protect, cor- 
responds to the maintenance of the blue item memory in the 
face of the distractor presentation. In terms of activity it corre- 
sponds to B maintained in the persistent state and _R that is not 
activated to the persistent state even when the red stimulus is pre- 
sented during the delay period. In networks (Figure IE) where 
population B and population R are not connected, the opera- 
tion protect can be separated in two independent sub-operations: 
maintain (maintain item memory in population B) and block 
(prevent activation of population _R). The third operation, clear 
corresponds to the clearance of the memory encoded in the net- 
work. This is equivalent to the erasing of the persistent activity in 
the network. Note that in this work we do not focus explicitly on 
the read-out mechanism following the presentation of the match 
stimulus. 



Frontiers in Computational Neuroscience 



www.frontiersin.org 



October 2013 | Volume 7 | Article 139 | 4 



Dipoppa and Gutkin 



Correlations allow working memory execution 



In particular in the winner-take-all network (resp. the two- 
unit network), operation load is executed with success if the 
sample stimulus activates population B. This is measured before 
distractor presentation during 350-450 ms (resp. 350-450 ms): 
vg > 5 Hz and vr < 5 Hz, where vg < 5 and vr denote the aver- 
age population firing rates of populations blue and red, respec- 
tively. Operation protect is executed with success if population B 
maintains the persistent state and population _R is not activated. 
This is measured before match presentation during 750-850 ms 
(resp. 700-800): vg > 5 Hz and vr < 5 Hz. Operation clear is 
executed with success if population B is deactivated at task com- 
pletion. This is measured during an interval after match presenta- 
tion, during 1 150-1250 ms (resp. 1050-1 150 ms): vg < 5 Hz and 
vr < 5 Hz. 

NUMERICAL ANALYSIS 

All the numerical results are obtained by algorithms run in 
Python. The differential equations are integrated with Euler steps 
of dt = 0. 1 ms. The mean population firing rate / is computed 
over population average in 10 ms. 

Data points for networks and associated error bars are com- 
puted by averaging over simulated individual network realiza- 
tions. We generated random connectivity matrices such that every 
neuron receives the same number of input connections. For a 
fixed network connectivity matrix, we computed the average over 
100 realizations of background activity and stimuli for each of 30 
random realizations of the network connectivity matrix when not 
otherwise stated. 

RESULTS 

EFFECTS OF CORRELATIONS ON PERSISTENT ACTIVITY STATE IN THE 
SINGLE-UNIT NETWORK: ERASING AND BLOCKING THE MEMORY 
TRACE 

We examine how correlations in the background activity control 
selective persistent activity in WM networks. Hence we start out 
by analyzing how background correlations affect the transitions 
between the quiescent and self-sustained states in our network 
model. 

Correlations in background activity are generated by the addi- 
tion of a common noise source to independent stochastic chan- 
nels (see Figure IB). By changing the relative firing rate of the 
common source with respect to the independent channels we 
control the correlation level X. We set two different protocols rep- 
resented in Figure 2A. In the first protocol, the correlation level 
is increased instantaneously from X = 0 to some value A. > 0 at 
500 ms. Therefore given that the stimulus activates the persistent 
state, this protocol allows us to test the effects of the correlations 
on the probability that the active state is erased and we refer to it as 
the erasing protocol. In the second protocol the correlation level is 
set X > 0 for all the time, before the transient stimulus appears. In 
this way it is possible to see the effect of correlations on blocking 
the ability of the stimulus, presented during 50-100 ms, to initiate 
the persistent state and we refer to it as the blocking protocol. 

We first demonstrate the prevalent effect of correlations: con- 
trol of active memory state and control of access to the memory. 
In an example of the erasing protocol the excitatory stimulus acti- 
vates the network into a persistent state; at 500 ms correlations are 



increased and the persistent state is disrupted (Figure 2A). In an 
example of the blocking protocol the excitatory stimulus is not 
able to activate the persistent state (see Figure 2B). In order to 
understand how these effects depend on the activity parameters 
we ran a large number of simulations where we injected back- 
ground activity with different correlation levels for 0 < X < 1 to 
networks with different connection probability c to measure how 
this effect spread thanks to the network architecture (Figure 2C). 
We compared networks with the same scaled synaptic strength 
/ such that cJN = const. = 5.2. In the erasing protocol we esti- 
mated the erasing probability P e (c, X) defined as the probability 
for the network to have the firing rate v < 5 Hz in the inter- 
val 800-900 ms. We discarded trials where the network is not in 
a persistent state (v > 5 Hz during 400-500 ms). In the block- 
ing protocol we estimated the probability that the correlations 
block the stimulus; the blocking probability Pb(c, X) defined as 
the probability for the network to have the firing rate v < 5 Hz 
in the interval 400-500 ms. This could also be seen as a gating 
of the persistent activity. We observe that for both protocols, the 
increase of both c and X disrupts the persistent state: in the first 
case by erasing it and in the second case by blocking its activation. 

We hence wanted to assess how the network size influences 
the stability of the persistent state under the various back- 
ground activity regimes (Figure 2D). We compared networks 
with different size N with an equal average synaptic input cJN = 
const. = 5.2. We measured both erasing probability P e (N, X) and 
blocking probability Pb(N, X) as a function of X. We observe that 
both the erasing probability and the blocking probability (P e and 
Pb) increase with the network size N. We observe that both for 
fixed c and for fixed N Pb > P e - Finally we studied the proba- 
bilities P e and Pb as function of N, fixing both / = 0.26 and the 
number of inputs that each neuron receives, i.e., cN = cost = 20. 
We computed these probabilities averaging over 500 trials. We 
found that with such a scaling both P e and Pb are approximately 
constant (Figure 2E). 

In order to determine whether the optimal stimulus param- 
eters to load of a memory (or activation of a persistent state) 
depend on the correlation strength we measured the loading 
probability (1 — Pb) as function of the stimulus strength (vi) and 
for different values of X (Figure 3A), we computed the probabil- 
ities of Figure 3 averaging over 300 trials. Different values of X 
change the amplitude of (1 — Pb) but do not shift the tuning with 
respect to vi. We also found that there are two peaks of (1 — Pb): 
one at about Vi ~ 20 Hz and another at about Vi ~ 50 Hz. To 
test whether the positions of the two peaks depend on the recur- 
rent network properties we measured the loading probability as 
function of vi and for different values of the recurrent synaptic 
strength / (Figure 3B). Similarly to the previous results, different 
values of / change the amplitude of (1 — Pb) but do not shift the 
peaks of the curves with respect to Vi. In summary this indicates 
that indeed the strength of the stimulus required to active the per- 
sistent state with a set probability is dependent on the background 
correlations, and yet the tuning is rather broad. 

To further investigate the effect of correlation on the stability 
of the persistent state we determined the lifetime of the sustained 
activity and the level of correlations prior to the erasing time. We 
defined the end of the persistent state f st0 p (magenta vertical line, 
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FIGURE 2 | External background correlations destabilize the 
persistent state in a single-unit network. (A) Erasing persistent state 
with correlations. Examples of firing rate (top), and average synaptic 
input for one trial. X = 0 until 500 ms and X = 0.8 after 500 ms (yellow 
shaded areas). The population is activated by a stimulus during 
50-100 ms. Correlations in background activity erase the persistent 
state. (B) Correlations gate the activation of the persistent state. 
X = 0.8 all the time (yellow shaded areas). The network receives an 
excitatory stimulus during 50-100 ms. The stimulus fails to activate the 



persistent state in presence of background correlations. 

(C) Erasing probability P e (continuous lines) and blocking probability Ft, 
(dashed lines) as function of c and X. Synaptic strength is scaled such 
that cJN = 0.52. Both P e and Pj, increase with increasing X and c. 

(D) P e (continuous lines) and Pt (dashed lines) as function of N and X. 
Synaptic strength is scaled such that cJN = 0.52. Both P e and P b 
increase with increasing X and W. (E) P e and P D as function of N with 
fixed X = 0.6 and J = 0.26 and with c scaled such that 

cN = const =20. P e and P D remain approximately constant. 



Figure 4A) as the first period of 10 ms (after the correlation onset) 
during which the firing rate of the network falls below 5 Hz. 
Noticing that in most of the trails a peak of activity was preced- 
ing the persistent state erasing, we defined the time of such a peak 
fpeak (black vertical line, Figure 4A) as the last period of 10 ms 
before t stop that the firing rate attains a local maximum (in time) 
and that is beyond 20 Hz. We determined for each trial where the 
persistent state was not erased before the onset of correlations 
f corr = 800 ms (red vertical line, Figure 4A), the interval At c p . = 



fpeak 



. We determined the interval Af, 



p.S. 



stop 



fpeak- We 



performed this protocol for three different values of the corre- 
lation level: X = {0.3, 0.6, 0.9} (Figure 4B). We found that the 
distribution of Af c . p . decreases with time for all the values of 



correlations. When the level of correlations is larger (Figure 4B, 
top) the probability of reaching the peak earlier in time slightly 
increases with A. Furthermore we found that the interval between 
the peak of activity and the erasing of the activity in the network is 
narrowly distributed in time. Finally this interval is independent 
of the correlation level, meaning that the correlations do not have 
a strong effect on this timing (Figure 4B, bottom). We computed 
these distributions averaging over 500 trials. 

The mean Pearson correlation coefficient p (see Materials 
and Methods) of the synaptic input in the network during the 
interval with uncorrelated background activity was compared 
with that during the interval with correlated background activ- 
ity just preceding the peak. Only trials where t peil k ~ f con- > 



Frontiers in Computational Neuroscience 



www.frontiersin.org 



October 2013 | Volume 7 | Article 139 | 6 



Dipoppa and Gutkin 



Correlations allow working memory execution 



100 ms were considered. The interval with uncorrelated back- 
ground activity is defined as the 100 ms preceding f corr (gray 
shaded area, Figure 4A). The interval with correlated background 
activity is defined as the 100 ms preceding (red shaded area, 
Figure 4A). We computed p for the background input (red lines, 
Figure 4C) and for the recurrent input (black lines, Figure 4C) 
both for the uncorrelated interval (dashed lines) and for the 



correlated input (continuous lines) when k = 0.6. We found 
that p during the correlated input is smaller in the recurrent 
input with respect than in the background input. However, p 
of the recurrent input is larger during the correlated interval 
than during the uncorrelated interval. Interestingly we found that 
during the correlated interval, while the correlation coefficient 
of the background input increases with k (Figure 4D, bottom), 
the correlation coefficient of the recurrent input instead remains 
approximately equally distributed when k is changed (Figure 4D, 
top). This suggests that the network has reached the maximal 
amount of sustainable correlations before turning off. 

To understand whether the persistent activity deactivation is 
caused by an increase of spike synchrony we tracked the syn- 
chrony of the spike times using the multivariate SPIKE-distance 
measure S (Kreuz et al, 2013) (Figure 5A). The spike synchrony is 
given by 1 — S spanning the values between 0 (no synchrony) and 
1 (perfect synchrony). We compared the average spike synchrony 
during two intervals, similarly to Figure 4: the first interval corre- 
sponds to the 100 ms preceding the start of correlated background 
activity and the second interval corresponds to the 100 ms pre- 
ceding the last peak of activity before the deactivation of the 
persistent activity (provided that the onset of this last interval 
does not precede the start of the correlated background activ- 
ity). The distribution of the average value of 1 — S (computed 
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FIGURE 4 | Persistent state suppression is preceded by an increase 
of recurrent correlation. (A) Timing outline of erasing persistent 
activity. Mean recurrent input (blue trace), mean background input (red 
trace), and external input (black trace) are represented together with the 
time at which activity is erased (f s top, magenta vertical line), time of the 
last peak of activity before erasing (f pea k, black vertical line), and time 
of the onset of the correlations in background activity (f corr , red vertical 
line). The interval of uncorrelated activity and the interval of correlated 
background activity during which the correlation coefficient is measured 



in panels (C) and (D) are represented with gray and red shaded areas, 
respectively. (B) Distribution of the interval A f c p = f peak — f corr (top) and 
distribution of the interval Af p . s . = f stop — f P eak (bottom) for different 
values of X. (C) Mean Pearson correlation coefficient (p) of the 
recurrent input (black traces) and of the background input (red traces), 
computed during the uncorrelated interval (dashed traces) and the 
correlated interval (continuous traces). (D) Coefficient p of the recurrent 
input computed during the correlated interval for different values of X 
(top). Same analysis for the background input (bottom). 
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FIGURE 5 | Persistent state suppression is preceded by a weak increase 
of spike synchronization. (A) Raster plot of 30 representative neurons of 
the network (top) and spike synchrony 1 — S (bottom). Same protocol of that 
described in Figure 4. Gray shaded area corresponds to the 100 ms interval 
preceding the background correlation onset [X = 0.6); red shaded area 



corresponds to the 100 ms preceding the last peak of activity before 
sustained activity suppression. (B) Distribution of the average spike 
synchrony (1 — S) during the two interval described previously. Inset 
corresponds to a magnification of the relevant interval of spike synchrony 
values. 



over 2000 trials) during these two intervals shows that there is a 
weak increase of spike synchrony preceding the persistent activity 
deactivation with respect to the case of uncorrelated background 
activity (Figure 5B). This weak increase could indicate that few 
spike coincidences might be the cause of the persistent activity 
turning off. 

EFFECTS OF BACKGROUND ACTIVITY CORRELATIONS IN A 
WINNER-TAKE-ALL NETWORK 

We show here that modulating appropriately in space and time 
the correlation level of the background activity in a network per- 
forming a WM task significantly improves correct execution of all 
the required operations: load, protect, and clear. 

We compared two different versions of the winner-take-all 
network; each made of two excitatory populations B and -R, 
representing respectively colors blue and red. The two popu- 
lations interact via a third population of inhibitory neurons 
that creates a winner-take-all mechanism. The two versions dif- 
fer in that the first one receives only uncorrelated background 
activity while in the second each excitatory population receives 
also background activity from a different common noise source 
(Figure ID). 

We fixed the stimuli sequence as follows: during 50-150 ms 
a sample blue stimulus excites population B; during 450-550 ms 
a distractor red stimulus excites population _R; during 850-950 a 
match blue stimulus excites again population B. The operations 
that the network has to do are to load the blue item in memory, 
to protect the memory at red item presentation, and to clear the 
memory after the match presentation. 

Brunei and Wang (2001) pointed out that in order to per- 
form the DMS task correctly, the distractor stimulus strength 
needs to be controlled with care: above a certain strength per- 
sistent memory-trace is perturbed by the distractor. For our 
case we suppose that it is reasonable to assume that all sen- 
sory stimuli in the task are of the same strength. As a prelim- 
inary test we want to confirm that in absence of background 
correlations the network without common noise source does 
not perform efficiently when the stimuli are too strong, as was 
already stated in the reference network described by Brunei and 



Wang (2001). In the example shown in Figure 6A the distrac- 
tor activates R and via the inhibitory population the persistent 
state in B is deactivated leading to a failure of the operation 
protect. 

We then consider the network represented in Figure ID that 
allows the modulation of the correlation level A. in each exci- 
tatory population independently. The network initially receives 
uncorrelated background activity to k = 0.9. After the first 
item has been loaded, the system increases the correlation 
level in the background activity of the other non-activated 
population R. After the match stimulus has been presented, 
the correlation level is increased also in population B to 
k = 0.9. 

We show an example of the network executing the WM task 
where the correlation level is modulated independently in the 
excitatory populations (Figure 6B). In this particular example 
we illustrate a trial where the network performs the required 
operations of the WM task (compare with Figure ID and see 
below for statistics across trials). The distractor excites R only 
transiently such that excitation does not last enough to dis- 
rupt the activity in B, in addition as shown below this happens 
also for strong distractor stimuli. Therefore the operation protect 
has been executed with success and the memory is maintained. 
At the end of the match stimulus the persistent activity is dis- 
rupted also in population B caused by the increase of k in that 
population too. Therefore the operation clear is executed with 
success and the memory is erased in the network. This exam- 
ple illustrates that the success of the operations protect and 
clear in the network with correlations are not due to the pres- 
ence of inhibition as was set in the model of Brunei and Wang 
(2001). 

To get quantitative measures of performance for these two 
networks (with and without correlations in background activ- 
ity), we analyzed the statistics of load and protect performance, 
as a function of the stimulus intensity vi (and thus its strength) 
(Figure 7A). We consistently find higher protect performance 
for correlated background activity than for uncorrelated back- 
ground activity throughout the whole range for Vi. In fact 
the success of the protect operation depends only gradually on 
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FIGURE 6 | Selective correlations implemented in a working memory 
task. Two competing populations network, with two item-selective excitatory 
populations (blue and red) and one inhibitory non-selective population (black). 
(A) Without background correlations, the distracting stimulus activates 
population Ft and population B is deactivated. (B) After the activation of B at 
150 ms, a common source of noise increases the correlations in background 



activity {X = 0.9) in Ft. The correlations block the activation of Ft and maintain 
the persistent state B. After the completion of the task at 950 ms the 
correlations erase persistent activity in B. (Top) Raster plot of the neural 
activity in the task. (Bottom) Successively: sample stimulus to B (50-150 ms), 
distracting stimulus to Ft (450-550 ms), and match stimulus to B 
(850-950 ms). 




FIGURE 7 | Background correlations increase working memory 
performance. Protocol reported in Figure 6. (A) Comparison between a two 
competing populations network with and without correlations. Dashed line: 
optimal value for the network with correlations. (B) The performance of the 
network is measured on four different operations for the optimal value of 



vi = 4.8 Hz: probability of activating B by the sample stimulus (load), 
probability of preventing memory disruption by a distracting stimulus in the 
protocol with correlations (protect), probability of erasing of the memory at 
the end of the task (clear). All probabilities have a high value showing that the 
network has good task performance, above chance. 



the distractor strength. On the other hand in order to per- 
form operation protect above chance level in the network with 
uncorrelated background activity distractors should be care- 
fully adjusted to have intensity vi < 5 Hz. However, in this 
range the operation load is suboptimal. Hence the uncorre- 
lated model fails in the task. This fact illustrates a recurrent 
problem in the protect-by-inhibition paradigm: it needs fine- 
tuning and achieves only low performance if the stimuli are 
too strong. Instead, using correlations as a mechanism to pro- 
tect the activity does not need precise fine-tuning as can been 
seen in the large range in which both load and protect are 
well above chance level. We found the value vi = 4.8 Hz max- 
imizes the joint probability of executing with success load and 



protect (Figure 7A, vertical dashed line). We show in Figure 7B 
probability of success of the three operations load, protect, and 
clear finding that all of them score a value higher than chance 
level. 

IMPLEMENTING WORKING MEMORY TASK BY FLEXIBLE 
CORRELATIONS MODULATION 

We now go on to show that mutual inhibition is not a required 
mechanism for implementing the WM task. We show here that 
modulating appropriately the background activity correlations 
in time in a network without inhibitory population allows cor- 
rect execution of all the required WM operations: load, maintain, 
block, and clear ( Please note that since the network studied 
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here is made of two separated excitatory populations the com- 
ponent maintain and block of the operation protect can be treated 
separately). 

Network operating regimes 

In order to characterize the network performance statistics during 
the task we need to track three probabilities. The first probability 
P g 0 = P e P b corresponds to the joint probability of deactivat- 
ing by correlations the network that is in the persistent state 
(erase) and to block activation of the network that is in the 
quiescent state and is excited by a stimulus. When P go . dom- 
inates over the other probabilities the system is in a gate-out 
regime, i.e., memory cannot neither be loaded nor maintained 
in the network. The second probability P g ; = (1 — P e )(l — Py) 
corresponds to the joint probability that, despite the correlations, 
the network maintains the persistent state, if previously acti- 
vated, and that the stimulus activates the persistent state when 
the network is in the quiescent state. When P g ; dominates, the 
system is in a gate-in regime, i.e., the memory can be loaded 
and maintained in the network. Finally the third probability 
P s g = (1 — P e )Pf, corresponds to the probability of maintain- 
ing the persistent activity in the presence of correlations while 
blocking the activation of a persistent state with correlated back- 
ground activity when the system is in a quiescent state and is 
excited by a stimulus. When i\ g . dominates the system is in a 
selective-gate regime, i.e., the memory is maintained but cannot 
be loaded. In a sense we want to show that correlations in the 
background activity can selectively switch the network from the 
gate-in regime at the outset of the task, to the selective-gate regime 
during the memory period. We do not consider the probability 
P e (l - P h ). 

To obtain the network performance on the DMS task we con- 
sidered the statistical results presented in Figure 2 for the single 
excitatory population (N = 1000 and c = 0.2). We note that there 
is a difference between the erasing probability P e {X) and the 



blocking probability Pb(X) in function of the correlation level. In 
Figure 8 we present the results for network we consider in this 
manuscript. We see that when P g .;.(^) dominates (X < 0.04), the 
system is in a gate-in regime, i.e., the memory can be loaded and 
maintained in the network (Figure 8). When Ps.g.O*-) dominates 
(0.04 < X < 0.11) the system is in a selective-gate regime. We do 
not consider here the gate-out regime that corresponds to P g . 0 . (X) 
dominating over the other probabilities (X > 0.11 ). We set the 
gate-in regime at X = 0 and the selective-gate regime at X = 0.07. 

Modulation of correlation level in time 

We now show that correlations induced by a global common noise 
source to the whole network executes the DMS task efficiently by 
modulating the correlation level X during the different phases of 
the task. We note that in the mutual inhibition model, at task 
completion, increase in the correlation level induces the gate- 
out regime and erases the memory. We show here, in a two-unit 
model (Figure IE), how the presentation of the match stimu- 
lus directly can erase the memory thereby implementing a direct 
match-based suppression without requiring inhibition. In this 
model each of the two excitatory populations receives background 
activity from sources independent to each neuron and from a 
noise source common to all neurons. 

An example of the network performing the DMS task is rep- 
resented in Figure 9A. The stimuli are presented in the following 
sequence: sample stimulus to population B at time during 100- 
150 ms, distractor stimulus to population _R during 450-500 ms, 
and match stimulus to population B at time 800-850. In the 
beginning the system is in the gate-in regime (X = 0): the sam- 
ple stimulus activates B. From 300 ms the network is set in a 
selective-gate regime (X = 0.07): the distractor stimulus activates 
transiently population R while persistent activity is maintained 
in population B. At the end of the task the match stimulus, first, 
increases the activity in B and, then, destroys it. 

We can then compute the task performance of the network, 
corresponding to the success rate that the operations load, main- 
tain, block, and clear are executed successfully (Figure 9B). These 
measure are all above chance level. Notice the high level of 
performance of the clear operation. 

DISCUSSION 

RESULTS AND DATA DISCUSSION 

In this work we present a novel paradigm explaining how the 
persistent activity can be modulated on-line by the mean of 
both information-related signal and background activity. This 
paradigm is based on our result showing that background cor- 
relations influence the transition between the persistent state and 
the quiescent state in a bistable recurrent neural network. We call 
this phenomenon correlation-induced gating. 

In order to implement a multi-unit network performing a WM 
task, we began by establishing the basis of the correlation-induced 
gating on a single-unit network. We show that background cor- 
relations block and erase a persistent state in a homogeneous 
recurrent neural network representing a single unit. We found 
that the transition rate from the persistent state to the quies- 
cent state increases, with the network size and with the con- 
nection probability. For all situations the probabilities increase 
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FIGURE 8 | Correlations set the network working regime. Probability 
that the network operates in different regimes with network size N = 1000. 
Joint probability of (not-)erase and (not-)block: P g . 0 .M (black curve), Pg.i.M 
(blue curve), and P sg . (X) (red curve). Gate-out regime corresponds to 
domination of P g . 0 . (A.) and falls in the range X > 0.11 . Gate-in regime 
corresponds to dominance of P g .i.(A.) and falls in the range X < 0.04. 
Selective-gate corresponds to dominance of P s . g .M and falls in the range 
0.04 < X < 0.11, with maximal value at X = 0.07 (red star). 
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FIGURE 9 | Spatially uniform correlations in a two unit network 
performing a working memory task. (A) The network has size N = 1000. 
Memory is loaded in population B by the sample stimulus. Background 
correlations block the activation of persistent population Ft by a distractor 
while maintaining the memory in the population B. The match stimulus 
erases the memory in population B, playing both the role of read-out and 



clear. (Top) Raster plot of the neural activity for populations B and Ft. (Bottom) 
Input current of the: sample stimulus, distracting stimulus, and match 
stimulus. The network has size W = 1000. (B) With intermediate correlation 
level (X = 0.07) in background activity the network can execute successfully 
the working memory task. Task performance of the network for the four 
operations: load, block, maintain, clear. 



with the correlation level. Increasing the network size, while fix- 
ing the connections probability and renormalizing the synaptic 
inputs to keep the average input strength constant scales up 
the probabilities. In other words, in larger size network with 
weaker but more numerous synapses, correlations appear to have 
a stronger effect. On the other hand, when we fix the total 
number of synapses each neurons receives, growing network 
size does not appear to have much effect on the correlation 
driven probabilities. These effects could be related to the fact 
that the amount of correlation between neurons sharing common 
input is mainly determined by pooling (Rosenbaum et al, 2010, 
2011). 

We implemented a winner-take-all network composed of two 
excitatory populations and one inhibitory population. Each of the 
excitatory populations receives background input from indepen- 
dent noise sources and a noise source common to the neurons 
of such population. The amount of correlation could be changed 
independently in the two excitatory populations. By increasing 
the level of correlations in the populations encoding an irrelevant 
information we prevented a distractor from loading a mem- 
ory item in such population. In particular we showed that this 
model allows to prevent stronger distractors with respect to a 
model inspired by Brunei and Wang (2001) where the distrac- 
tor is blocked only by the mutual inhibition. Our model could 
therefore explain how the response to the distractor stimulus 
in a WM task could be as strong as for the sample stimulus 
(Miller et al., 1996). This effect would be in fact not compat- 
ible with a model where a distractor is prevented by mutual 
inhibition. 

We implemented a WM network differing by the same pre- 
vious one in the construction of background correlations that 
are induced by a shared source. We show that modulating the 
correlation level in background activity we can set the system 
in the different regimes. This time instead of modulating the 
correlations level "in space" we modulate it in time. Depending 
on the strength of the correlations the system is set in dif- 
ferent operating points, namely the gate-in, selective-gate, and 



gate-out regimes. The gate-in regime allows to load a mem- 
ory in the WM store and to maintain it subsequently. The 
selective-gate regime maintains a previously loaded memory 
but blocks the load of any new memory. The gate-out regime 
blocks the network both to load and to maintain a memory. 
We can switch instantaneously from one dynamic regime to the 
other by tuning the strength of the background activity corre- 
lations. We further show that the projection of a strong match 
stimulus can be sufficient to clear the memory at task com- 
pletion, thereby suggesting that correlations also play a role in 
match-suppression. 

We must also note that in this work we considered spa- 
tial correlations and their effect on the persistent activity and 
WM task executions. In a companion paper we have shown 
that temporal structure also has an important effect: the gat- 
ing modes are modulated by the oscillatory frequency content 
of the background activity (Dipoppa and Gutkin, 2013). While 
in the companion paper the block and erase probabilities, and 
thus the gating modes of the network, are modulated by the 
oscillation frequency, in this work they are modulated by the 
correlation level. As opposed to the non-monotone relationship 
between the oscillation frequency and the block and erase prob- 
abilities [Figure 3A of Dipoppa and Gutkin (2013)], there is a 
monotone relationship between the correlation level and the same 
measures (Figures 2C,D). Hence control of the WM through spa- 
tial correlations could be implemented by a simple increase or 
decrease of activity within a neural population furnishing con- 
nections common to the WM store, while the oscillatory control 
would require more complex task-dependent shifting between 
the frequency bands. We would like to speculate that the two 
mechanisms could represent two independent modes of control 
over the WM networks. Furthermore, in this work we uniquely 
examine the role of mutual inhibition and show that the spatial 
correlation structure alleviates the network sensitivity to stimulus 
strength. 

Although we do not propose a mechanism for the read- 
out of the memory information we note that the mechanism 
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proposed by Brunei and Wang (2001) for their network would 
be compatible with our model. This mechanism corresponds to 
the fact that a match stimulus will elicit a stronger response 
with respect to a distractor stimulus in the first few tenths 
of milliseconds since the first will excite a network that is 
already in the persistent state. Hence we might speculate that 
a complementary population of neurons sensitive to rapid 
transients in the activity might be a way to signal read-out 
differentially. 

MODEL PREDICTIONS AND OPEN QUESTIONS 

The novel paradigm that we present here allows to manip- 
ulate persistent activity through background correlations. An 
advantage of the correlation-induced gating with respect to the 
inhibition-induced gating is that the gate can be rapidly and flex- 
ibly opened or closed depending on the correlation level, instead 
of being fixed by the network connectivity structure. 

The effects that we find for the flexible changes in the cor- 
relation levels is the major prediction of the model. We predict 
that an examination of multi-unit electrophysiological record- 
ings of animals performing a WM task will show the following 
modulation of correlation level: low level during loading and 
intermediate level during maintenance (as in the two-unit model 
of Figure IE) or alternatively high level of correlations in the pop- 
ulation of neuron selective for a non-memorized item during the 
delay period (as in the winner-take-all model of Figure ID). To 
our knowledge experiments specifically analyzing how correla- 
tions change in the PFC as the delay-response task unfolds are 
still lacking. 

At the same time, there are several lines of indirect evidence 
that lead us to believe that task dependent correlation modu- 
lation is indeed possible. First, it has been found that there is 
a modulation of spike coincidences during different phases of 
a motor task (Riehle et al., 1997). Riehle et al. (1997) found 
that at times during the delay when the animal was expect- 
ing to generate a response there were transients of synchronized 
spikes. Furthermore for successful trials there were more syn- 
chronized spikes during the delay period than for failure trails. 
This indeed suggests that spike coincidence is modulated in a 
functional way. The increase of excess synchrony at response (or 
expected response) times is compatible with the correlation based 
memory clearance discussed in this manuscript. Furthermore, it 
has been found that a change in representation during the delay- 
response task leads to an increase of synchronization (Sakamoto 
et al, 2008). Pipa and Munk (2011) analyzed multi-unit activ- 
ity during the delay period of a match-to-sample task and found 
that on correct vs. incorrect trials there is a modulation of 
spike synchronization and further, synchronous spike events are 
more prevalent at match presentation. This last point again sug- 
gests that increased correlations may be involved in erasing the 
memory trace. 

In fact there is ample literature relating changes in oscillatory 
synchrony, coherence and frequency during WM tasks (Tallon- 
Baudry et al, 1998; Pesaran et al, 2002; Lee et al, 2005; Pipa et al., 
2009). For example Pesaran et al. (2002) found that gamma-band 



spiking coherence is increased during the delay period in the 
lateral intraparietal cortex (LIP) in primates performing a delayed 
response task. Given that LIP is coupled to the PFC and is also 
involved in WM trace (Chafee and Goldman-Rakic, 1998), this is 
suggesting of increased input correlations to the PFC during the 
WM task. In the context of irregular poisson firing, oscillatory 
coherence is nothing other than correlations organized both in 
time (the frequency) and space. Oscillatory effects are beyond the 
scope of this paper and are a subject of the companion manuscript 
(Dipoppa and Gutkin, 2013). 

The data reviewed above does show that there is a modu- 
lation of activity correlations during the WM task, yet it does 
not provide the mechanism. Here we propose that the mech- 
anism is in the background input correlations generated by a 
common source. One hence might ask where such inputs may 
be coming from. As hinted above, one source could be coher- 
ent firing activity in the cortical regions coupled to the PFC 
and involved in WM processing (e.g., LIP). In addition, we 
propose that the source of shared background input generat- 
ing spatial correlations can reside in the striatum, a subcortical 
area thought to be involved in WM. In fact the structure of 
the cortico-striatal loops as been longly seen as a disadvantage 
for the WM capacity if the memory store is located also in the 
striatum. Since the number of striatal neurons is much lower 
than the number of pyramidal neurons (Lange et al, 1976) 
and the loop is based on divergence (resp. convergence) in the 
striato-cortical (resp. cortico-striatal) direction, then the stria- 
tum could not have the same memory capacity of the cortex. It 
has been suggested that instead that divergent/convergent struc- 
ture could be useful since the basal ganglia do not encode the 
individual information of WM but they control the gate of other 
region and decide when they can be updated (Frank et al., 2001). 
We also suggest that striatum plays a gating role since it could 
be the source of the common noise that creates the different 
regimes. 

The correlation-induced gating is a robust effect to param- 
eters variation. We propose the following explanation for this 
phenomenon: background correlations induce spike-times syn- 
chronization in the recurrent network, as was found similarly for 
independent neurons by Galan et al. (2006), and this leads to per- 
sistent activity erasing and block because of the refractory period 
of the neurons, as was found by Laing and Chow (2001) and 
Gutkin et al. (2001). Providing a proof of this assumption and a 
mathematical explanation of the correlation-induced gating will 
be the subject of future research. 
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